Papers with unsupervised text generation
Making Use of Latent Space in Language GANs for Generating Diverse Text without Pre-training (2021.eacl-srw)
Copied to clipboard
| Challenge: | Existing models for generating diverse texts are not pre-trained . generative adversarial networks suffer from mode-collapsing if they are not trained . |
| Approach: | They propose a GAN model that produces diverse texts conditioned by latent code . they propose to use Gumbel-Softmax distribution for word sampling . |
| Outcome: | The proposed model is competitive with existing models, which requires pre-training. |
GenWiki: A Dataset of 1.3 Million Content-Sharing Text and Graphs for Unsupervised Graph-to-Text Generation (2020.coling-main)
Copied to clipboard
| Challenge: | a large-scale, general-domain dataset is needed for knowledge graph-to-text generation . data collection is expensive and data-intensive, making it difficult to get good annotation . |
| Approach: | They propose to use a large-scale, general-domain dataset to generate unsupervised text from knowledge graphs. |
| Outcome: | The proposed dataset has 1.3M text and graph examples, and is a benchmark for future research . good annotation is expensive and difficult to get, and it's difficult to check quality . |
An Unsupervised Joint System for Text Generation from Knowledge Graphs and Semantic Parsing (2020.emnlp-main)
Copied to clipboard
| Challenge: | Knowledge graphs (KGs) vary greatly from one domain to another, resulting in a lack of domain-specific parallel graph-text data. |
| Approach: | They propose an unsupervised approach to graph-to-text generation and text-to graph knowledge extraction using WebNLG v2.1 and a new benchmark leveraging scene graphs from Visual Genome. |
| Outcome: | The proposed approach outperforms baselines on WebNLG v2.1 and a new benchmark leveraging scene graphs from Visual Genome. |